Search for: All records

Neural Radiance Fields (NeRFs) have been remarkably successful at synthesizing novel views of 3D scenes by optimizing a volumetric scene function. This scene function models how optical rays bring color information from a 3D object to the camera pixels. Radio frequency (RF) or audio signals can also be viewed as a vehicle for delivering information about the environment to a sensor. However, unlike camera pixels, an RF/audio sensor receives a mixture of signals that contain many environmental reflections (also called “multipath”). Is it still possible to infer the environment using such multipath signals? We show that with redesign, NeRFs can be taught to learn from multipath signals, and thereby “see” the environment. As a grounding application, we aim to infer the indoor floorplan of a home from sparse WiFi measurements made at multiple locations inside the home. Although a difficult inverse problem, our implicitly learnt floorplans look promising, and enables forward applications, such as indoor signal prediction and basic ray tracing. 

We consider the problem of personalizing audio to maximize user experience. Briefly, we aim to find a filter h*, which applied to any music or speech, will maximize the user’s satisfaction. This is a black-box optimization problem since the user’s satisfaction function is unknown. Substantive work has been done on this topic where the key idea is to play audio samples to the user, each shaped by a different filter hi, and query the user for their satisfaction scores f(hi). A family of “surrogate” functions is then designed to fit these scores and the optimization method gradually refines these functions to arrive at the filter ˆh* that maximizes satisfaction. In certain applications, we observe that a second type of querying is possible where users can tell us the individual elements h*[j] of the optimal filter h*. Consider an analogy from cooking where the goal is to cook a recipe that maximizes user satisfaction. A user can be asked to score various cooked recipes (e.g., tofu fried rice) or to score individual ingredients (say, salt, sugar, rice, chicken, etc.). Given a budget of B queries, where a query can be of either type, our goal is to find the recipe that will maximize this user’s satisfaction. Our proposal builds on Sparse Gaussian Process Regression (GPR) and shows how a hybrid approach can outperform any one type of querying. Our results are validated through simulations and real world experiments, where volunteers gave feedback on music/speech audio and were able to achieve high satisfaction levels. We believe this idea of hybrid querying opens new problems in black-box optimization and solutions can benefit other applications beyond audio personalization. 

The importance of phosphorus (P) in regulating ecosystem responses to climate change has fostered P-cycle implementation in land surface models, but their CO₂effects predictions have not been evaluated against measurements. Here, we perform a data-driven model evaluation where simulations of eight widely used P-enabled models were confronted with observations from a long-term free-air CO₂enrichment experiment in a mature, P-limitedEucalyptusforest. We show that most models predicted the correct sign and magnitude of the CO₂effect on ecosystem carbon (C) sequestration, but they generally overestimated the effects on plant C uptake and growth. We identify leaf-to-canopy scaling of photosynthesis, plant tissue stoichiometry, plant belowground C allocation, and the subsequent consequences for plant-microbial interaction as key areas in which models of ecosystem C-P interaction can be improved. Together, this data-model intercomparison reveals data-driven insights into the performance and functionality of P-enabled models and adds to the existing evidence that the global CO₂-driven carbon sink is overestimated by models.